Posterior contraction in Gaussian process regression using Wasserstein approximations
نویسندگان
چکیده
We study posterior rates of contraction in Gaussian process regression with potentially unbounded covariate domain. Our argument relies on developing a Gaussian approximation to the posterior of the leading coefficients of a Karhunen–Loève expansion of the Gaussian process. The salient feature of our result is deriving such an approximation in the L2 Wasserstein distance and relating the speed of the approximation to the posterior contraction rate using a coupling argument. Specific illustrations are provided for the Gaussian (or squared exponential) and Matérn covariance kernels.
منابع مشابه
Approximating Bayesian Posterior Means Using Multivariate Gaussian Quadrature
Multiple integrals encountered when evaluating posterior densities in Bayesian estimation were approximated using Multivariate Gaussian Quadrature (MGQ). Experimental results for a linear regression model suggest MGQ provides better approximations to unknown parameters and error variance than simple Monte Carlo based approximations. The authors are Graduate Research Assistant, Professor and Gra...
متن کاملRates of Contraction of Posterior Distributions Based on Gaussian Process Priors
We derive rates of contraction of posterior distributions on nonparametric or semiparametric models based on Gaussian processes. The rate of contraction is shown to depend on the position of the true parameter relative to the reproducing kernel Hilbert space of the Gaussian process and the small ball probabilities of the Gaussian process. We determine these quantities for a range of examples of...
متن کاملConvergence of latent mixing measures in nonparametric and mixture models
We consider Wasserstein distance functionals for assessing the convergence of latent discrete measures, which serve as mixing distributions in hierarchical and nonparametric mixture models. We clarify the relationships between Wasserstein distances of mixing distributions and f -divergence functionals such as Hellinger and Kullback-Leibler distances on the space of mixture distributions using v...
متن کاملAdaptive Bayesian Procedures Using Random Series Priors
We consider a general class of prior distributions for nonparametric Bayesian estimation which uses finite random series with a random number of terms. A prior is constructed through distributions on the number of basis functions and the associated coefficients. We derive a general result on adaptive posterior contraction rates for all smoothness levels of the target function in the true model ...
متن کاملVariational Bayesian Multinomial Probit Regression with Gaussian Process Priors
It is well known in the statistics literature that augmenting binary and polychotomous response models with gaussian latent variables enables exact Bayesian analysis viaGibbs sampling from the parameter posterior. By adopting such a data augmentation strategy, dispensing with priors over regression coefficients in favor of gaussian process (GP) priors over functions, and employing variational a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017